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1 Introduction 


Recent work of Marc Yor and coauthors ( 201li ) has drawn attention to how 
properties of a martingale are related to its family of marginal distributions. A 
fundamental result of this kind is Doob’s martingale convergence theorem: 


• if the marginal distributions {pntn > 0) of a discrete time martingale 
{Mn,n > 0) are such that J \x\fin{dx) is bounded, then M„ converges 
almost surely. 


Other well known results relating the behavior of a discrete time martingale 
to its marginal laws are: 

• for each p > 1, the sequence / \x\P^j,n{dx) is bounded if and only if Mn 
converges in LP\ 

• limj;_,.oo sup„ /| 2 ,|>y \x\^n{dx) = 0, that is (M„)„>o is uniformly integrable, 
if and only if Mn converges in L^. 


We know also from Levy that if Pn, is the distribution of a partial sum Sn of 
independent random variables, and /i„ converges in distribution as n —> oo, 
then Sn converges almost surely. These results can be fou nd in most modern 
graduate textbooks in probability. See for instance Durrett ( 2010ll . 

What if the marginals of a martingale converg e in d istribution? Does that 
imply the martingale converges a.s? Baez-Duarte ( 197lll and Gilat ( 1972ll gave 
examples of martingales that converge in probability but not almost surely. 
So the answer is to this question is no. But worse than that, there is a se¬ 
quence of martingale marginals converging in distribution, such that some mar¬ 
tingales with these marginals converge almost surely, while others diverge almost 
surely. So by mixing, the probability of convergence of a martingale with these 
marginals can be any number in [0,1]. Moreover, the same phenomemon can 
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be exhibited for convergence in probability: there is a sequence of martingale 
marginals converging in distribution, such that some martingales with these 
marginals converge in probability, but others do not. 

The purpose of this brief note is to record these examples, and to draw 
attention to the following problems which they raise: 


1. What is a necessary and sufficient condition on martingale marginals for 
every martingale with these marginals to converge almost surely? 

2. What is a necessary and sufficient condition on martingale marginals for 
every martingale with these marginals to converge in probability? 


Perhaps the condition for almost sure convergence is Doob’s L^-bounded 
condition. But this does not seem at all obvious. Moreover, L^-bounded is not 
the right condition for convergence in probability: convergence in distribution 
to a point mass is obviously sufficient, and t his con dition can hold for marginals 
that are not bounded in . See also Rao 1 1979ll for treatment of some other 
problems related to non-L^-bounded martingales. 


2 Examples 


2.1 Almost sure convergence 

This construction extends and simplifies the construction by Gilat ( 19721 . §2) of a 
martingale which converges in probability but not a lmost surely, with increments 
in the set { — 1,0,1} See also Baez-Duarte (1197111 for an earlier construction 
with unbounded increments, based on the double or nothing game instead of a 
random walk. 

Let (Sn, n = 0,1,2,...) be a simple symmetric random walk started at So = 
0, with (5^+1 — S„,n = 0,1, 2,...) a sequence of independent C/(±l) random 
variables, where f?(±l) is the uniform distribution on the set {±1} := (—1, Til- 
Let 0 = To < Ti < T 2 < • • • be the successive times n that S„ = 0. By 
recurrence of the simple random walk, P(Tn < 00 ) = 1 for every n. For each 
fc = 1, 2,... let be the process which follows the walk Sn on the random 

interval [T^.-i,Tk\ of its fcth excursion away from 0, and is otherwise identically 
0 : 

:= 5„l(Tfc_i < n < Tfc) 


where 1( - • •) is an indicator random variable with value 1 if • ■ • and 0 otherwise. 
Each of these processes is a martingale relative to the filtration (J-n) 

generated by the walk {Sn), by Doob’s optional sampling theorem. Now let 
(Afc) be a sequence of events such that the cr- field Qo generated by these events 
is independent of the walk {Sn,n > 0), and set 


M„:=^MWl(Afe) 
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So Mn follows the path of Sn on its fcth excursion away from 0 if Ak occurs, 
and otherwise Mn is identically 0. Let Qn for n > 0 be the cr-field generated 
by Qo and Tn- Then it is clear that is a martingale, no matter what 

choice of the sequence of events {Ak) independent of [Sn)- The distribution of 
Mn is determined by the formula 

OO 

P(Mn = x) = ^ P{Sn = x,Tk-i <n< Tk)P{Ak) 

k^l 

for all integers x ^ 0. A family of martingales with the same marginals is 
thus obtained by varying the structure of dependence between the events Ak 
for a given sequence of probabilities P{Ak). The only way that a path of Mn 
can converge is if is eventually absorbed in state 0. So if N J2k 
denotes the number of events Ak that occur, 


P{Mn converges) = P{N < oo). 


Now take P{Ak) = Pk for a decreasing sequence pfe with limit 0 but = oo, 

for instance pk = 1/k. Then (Ak) can be constructed so that the Ak are mutually 
indendent, and P{N = oo) = 1 by the Borel-Cantelli lemma. Or these events 
can be nested: 

Ai A A2 A A3 • • • 


in which case 

P(N > k) = P{Ak) 0 as fc —>• 00 , 

so P{N = 00 ) = 0 in this case. Thus we obtain a sequence of marginal dis¬ 
tributions for a martingale, such that some martingales with these marginals 
converge almost surely, while others diverge almost surely. 


2.2 Convergence in probability 

Let us construct a martingale M„ which converges in distributio n, bu t not in 
probability, following indications of such a construction by Gilat ( 19721 §1). 

This will be an inhomogeneous Markov chain with integer values, starting 
from Mq = 0. Its first step will be to Mi with t/(±l) distribution. Thereafter, 
the idea is to force M„ to alternate between the values ±1, with probability 
increasing to 1 as n —>■ 00 . This achieves t/(±l) as its limit in distribution, 
while preventing convergence in probability by the alternation. The transition 
probabilities of are as follows: 


PiMn+l =Mn±l\Mn with M„ ^ {±1}) = 1/2 (1) 

P{Mn+i = -11 M„ = 1) = 1 - 2-” (2) 

PiMn+l = 2"+i - 11 M„ = 1) = 2-" (3) 

P{Mn+i = +11 M„ = -1) = 1 - 2-^^ (4) 

P{Mn+i = -2"+i + 11 M„ = -1) = 2-’^ (5) 
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The first line indicates that whenever Mn is away from the two point set {±1}, 
it moves according to a simple symmetric random walk, until it eventually gets 
back to {±1} with probability one. Once it is back in {±1}, it is forced to 
alternate between these values, with probability 1 — for an alternation at 
step n, compensated by moving to ±(2"+^ — 1) with probability 2“". Since the 
probabilities 2“” are summable, the Borel-Cantelli Lemma ensures that with 
probability one only finitely many exits from {±1} ever occur. After the last 
of these exits, the martingale eventually returns to {±1} with probability one. 
From that time onwards, the martingale flips back and forth deterministically 
between {±1}. 

A slight modification of these transition probabilities, gives another martin¬ 
gale with the same marginal distributions which converges almost surely and 
hence in probability. With Mq = 0 as before, the modified scheme is as follows: 


P(M„+i = M„ ± 11 M„ with M„ i {±1}) = 1/2 (6) 

P(M„+i = 11 M„ = 1) = 1 - 2-" (7) 

P(M„+i = 2'^+! - 11 = 1) = 2->„ (8) 

P(M„+i = -2"+i + 11 M„ = 1) = 2—q^ (9) 

P(M„+i = -l|M„ = -l) = l-2-'^ (10) 

P(M„+i = -2’^+! + 11 = -1) = 2->„ (11) 

P(M„+i = 2’^+! - 11 M„ = -1) = 2->„ (12) 


where 

Pn := 1/(2 - 2“”) and := 1 - 

are chosen so that the distribution with probability Pn at 2"’+^ — 1 and qn at 
—2"+^ _(_ 2 ]^as mean 


P„(2'^+1-1)+<7„(-2"+i + 1) = 1. 

In this modified process, the alternating transition out of states ±1 is replaced 
by holding in these states, while the previous compensating moves to ±(2"’+^ —1) 
are replaced by a nearly symmetric transitions from ±1 to these values. This 
preserves the martingale property, and also preserves the marginal laws. But 
the previous argument for eventual alternation now shows that the modified 
martingale is eventually absorbed almost surely in one of the states ±1. So 
the modified martingale converges almost surely to a limit which has P(±l) 
distribution. 

These martingales (M„) have jumps that are unbounded. Gilat (ll972L 
§2) left open the question of whether there exist martingales with uniformly 
bounded increments which converge in distribution but not in probability. But 
such martingales can be created by a variation of the first construction of (M„) 
above, as follows. 

Run a simple symmetric random walk starting from 0. Each time the random 
walk makes an alternation between the two states ±1, make the walk delay for 
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a random number of steps in its current state in ±1 before continuing, for some 
rapidly increasing sequence of random delays. Call the resulting martingale M„. 
So by construction, Mi has U{±) distribution, 

M„ = {-if-^Mi for Sk<n<Tk 

for some increasing sequence of randomized stopping times 


1 = Si <Ti < S 2 <T2 < ■■■ , 

and during the fcth crossing interval [Tk,Sk+i] the process follows a sim¬ 
ple random walk path starting in state (—and stopping when it first 
reaches state (— 

The claim is that a suitable construction of the delays Tk — Sk will ensure that 
the distribution of Mn converges to 17(±1), while there is almost deterministic 
alternation for large k of the state Mt^, for some rapidly increasing deterministic 
sequence tk- To achieve this end, let ti = 1 and suppose inductively for k = 
1 , 2 ,... that tk has been chosen so that 

P{Mt^ = Ml) > 1 — tk for some 0 as fc —>■ cx). (13) 

Here Mi S {±1} is the first step of the simple random walk. The random 
number of steps required for random walk crossing between states ±1 is a.s. 
finite. So having defined tk, we can choose an even integer tk+i so large, that 
tk+i/2 > tk and all of the following events occur with probability at least 
1 — ik+l- 

• .Mtfe+ 1/2 = (—l)^“^Mi, meaning that the (fc — l)th crossing between ±1 
has been completed by time Sk < tfc+i/2; 

• the /cth crossing is started at time Tk that is uniform on \tk+il‘2,tk+i) 
given Sk < 4+i/2; 

• the fcth crossing is completed at time Sk+i < tfc+i, so Mn = (—l)*^Mi for 

Sk+i < n < tk+i- 

Moreover, tk+i can be chosen so large that the uniform random start time of 
the fcth crossing given Sk < tk+il2 ensures that also 

P{Mn S {±1}) > 1 — 2efe for all tk < n < tk+i 

because with high probability the length Sk+i — Tk of the fcth crossing is negligi¬ 
ble in comparison with the length tk+il2 of the interval \tk+i/2,tk+i\ in which 
this crossing is arranged to occur. It follows from this construction that Mn 
converges in distribution to 17(±1), while the forced alternation (fT^ prevents 
Mn from having a limit in probability. 

A feature of the previous example is that sup„ Mn = — inf„ = 00 almost 
surely, since in the end every step of the underlying simple symmetric random 
walk is made by the time-changed martingale M„. A similar example can be 
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created from a standard Brownian motion [Bt, t > 0) using a predictable {0,1}- 
valued process {Ht , t > 0) to create successive switching between and holding 
in states ±1 so that the martingale 


Mt := f HtdBt 
Jo 


converges in distribution to C/(±l) while not converging in probability. In this 
example, Htdt = sup^ Mt = — inft Mt = oo almost surely. 


Ackn owled gement 
Gilat (Il972h . 


Thanks to David Aldous for drawing my attention to 
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